Spin Analogs of Proteins: Scaling of "Folding" Properties 
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Reaching a ground state of a spin system is analogous to a protein evolving into its native state. 
We study the "folding" times for various random Ising spin systems and determine characteristic 
temperatures that relate to the "folding". Under optimal kinetic conditions, the "folding" times 
scale with the system size as a power law with a non-universal exponent. This is similar to what 
happens in model proteins. On the other hand, the scaling behavior of the characteristic temper- 
atures is different than in model proteins. Both in the spin systems and in proteins, the folding 
properties deteriorate with the system size. 
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I. INTRODUCTION 

Recent numerical studies indicate that character- 
istic folding times, tf id, of model proteins grow with the 
number of aminoacids, N, as a power law with an expo- 
nent which is non-universal - it depends on the class of 
sequences studied and on the temperature. The result- 
ing deterioration of the folding properties also manifests 
itself in the way in which temperatures that relate to fold- 
ing scale with N There are two such characteristic 
temperatures: Tf and T m i n . The first of these is a mea- 
sure of the thermodynamic stability - it can be defined 
operationally as a temperature at which the probability 
to occupy the native (the lowest energy) state crosses \ . 
The second temperature is one at which the folding kinet- 
ics is the fastest. At temperatures, T, below T m i n , glassy 
effects set in. Aminoacidic sequences that correspond to 
proteins should have a Tf that is bigger than T nl i n , or 
at least comparable to T m i n . Otherwise the sequences 
are bad folders. Studies || of two and three dimensional 
lattice Go models |3) of proteins suggest that T m i n grows 
with N whereas Tf first grows and then it either saturates 
or it grows at a lower rate than T m i n . There exists then 
a characteristic size, N c , at which T m i n starts exceeding 
Tf and for N > N c the sequences necessarily become bad 
folders. This suggests existence of a size related limit to 
physiological functionality of proteins. 

The question we ask in this paper is to what extent 
the scaling behavior of tfoid, Tf, and T m i n that was 
found in the lattice Go model of proteins is typical or, in 
other words, what are the classes of universality for these 
quantities. Specifically, we consider Ising spin systems: 
uniform ferromagnets, disordered ferromagnets and spin 
glasses. Disordered ferromagnets has been shown re- 
cently Q to have a phase space structure, as described by 
the so called disconnectivity graphs quite akin to 

that characterizing proteins, at least for a small number 
of spins, N. Spin glasses, on the other hand, have been 
found to have the phase space structured as in random 
sequences of aminoacids which are bad folders. The spin 



systems do not "fold" but an evolution into their ground 
states can be considered to be analogous to the folding 
process [|||] and tf u can be defined as the characteris- 
tic time needed to pass through the ground state for the 
first time, which generally does not coincide with a relax- 
ation time. Thus tfoid, Tf, and T m i n can be determined 
like for the proteins and we may additionally enquire how 
do Tf and T m i n relate to the effective critical tempera- 
ture as determined from the specific heat and magnetic 
susceptibility. 

Another motivation to consider the "folding" in spin 
systems is that the analogies between spin systems and 
proteins have already permeated the language in which 
the physics of proteins is couched. It is not clear, how- 
ever, to what extent these analogies are accurate when 
it comes to actual details. One qualitative concept, in 
this category, is that of the energy landscape ||[l0| : spin 
glasses are said to have rugged energy landscapes but 
proteins should have a landscape which is much smoother 
and funnel-like. Another such concept is frustration 
the structural frustration in proteins should be "mini- 
mal" whereas the frustration in the exchange couplings 
leads to the slow kinetics as found in spin glasses. These 
concepts have been probed, e.g. in the random energy 
model which again originated in the context of spin 
glasses |12|| . 

The basic message of this paper is that the spin - pro- 
tein analogies are indeed valid but the details of the be- 
havior are usually distinct. What is analogous, for in- 
stance, is that the folding times have a characteristic U- 
shaped dependence on T p3| . Furthermore, the folding 
properties are the best for small system sizes and then 
they deteriorate with N. In particular, the "folding" 
times at T m i n in spin systems do grow as a power law 
with N. On the other hand, both Tf and T m i n of simple 
spin systems generally decrease with N and the nature 
of the phase transition is not a finite size version of the 
first order as is the case with the proteins. 

The origins of the difference between spin systems and 
the Go models of proteins in the behavior of Tf and 
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T m in remain to be elucidated. It should be noted that 
there are no kinematic constraints on flips of any spin 
whereas the possible moves in the protein folding process 
must preserve the chain connectivity and they have to 
depend on the actual conformation and thus on the his- 
tory. The constrained character of the protein dynamics 
makes it acquire aspects of the packing problem, espe- 
cially so if the native state is maximally compact - such 
as considered in the studies of scaling in model proteins. 
The packing aspects become insignificant when dealing 
with longer and longer a-helices [Q. We illustrate this 
point here by considering a 2-dimensional lattice version 
of the a-helices (H) as described within the Go scheme 
and show that these objects indeed become behaving like 
spin system when ./V becomes bigger and bigger. Notice 
that the helices have the monomer-monomer interactions 
of a local kind. Thus the energy barrier against unfolding 
essentially does not depend on N which is not expected 
of structures with more complex contacts. 

Most of this paper, however, will be focused on systems 
described by the Ising spin Hamiltonian: 

H = - 2J JijSiSj , (1) 

<ij> 

where Si — ±1, and the exchange couplings, Jy, connect 
nearest neighbors on the square and cubic lattices with 
the periodic boundary conditions. There arc L D spins 
in the system where D denotes the dimensionality and L 
the linear size of the system. We consider four models 
of the exchange couplings: 1) spin glasses (SG) in which 
the Jjj's are numbers drawn from the Gaussian proba- 
bility distribution with a zero mean and a unit disper- 
sion; 2) uniform ferromagnets (FM) with Jy = 1; 3) the 
disordered ferromagnets (DFM) with chosen as the 
absolute values of the Gaussian numbers; 4) the weakly 
disordered ferromagnets (DFM') with the J^'s being ran- 
dom numbers between 0.9 and 1.1. We find that it is the 
latter system which is the most protein-like. 

In Sections 2 and 3 we discuss the T and N - 
dependencies of the "folding" times respectively. In Sec- 
tion 4 we present results on the scaling behavior of Tt and 
T mm in systems SG, FM, DFM, DFM', and H. Finally, 
in Section 5, we demonstrate that the temperatures we 
study are quite distinct from the critical temperature of 
the spin systems. 

II. TEMPERATURE DEPENDENCE OF 
"FOLDING" TIMES 

The concepts used in this paper are illustrated in Fig- 
ure 1 which shows the temperature dependence of the 
characteristic "folding" time in the D=2 Ising spin sys- 
tems considered. In each category, data for a represen- 
tative example system arc shown. We obtain tf Q id by 



a standard Monte Carlo process in which one typically 
starts from 1000 random initial spin configurations and 
determines the median time to reach the ground state 
for the first time. The spins are updated sequentially 
and the "folding" times are given in Monte Carlo steps 
per spin, i.e. the total number of spin updates divided by 
the number of spins. In the SG case, the ground state (or 
at least its close approximation) is obtained by multiple 
slow annealing processes followed by a quenching proce- 
dure. The general shape of the T-dependence is like in 
the protein systems - it corresponds to a U-shaped curve 
with a minimum at T m i n . The bigger the disorder, the 
higher the T m i n - the DFM system has the highest T m . m 
among the systems with the ferromagnetic ground state. 
Figure 1 also shows that the SG system has a lower value 
of T m i n than the DFM. However, this does not reflect the 
degree of the disorder since the two systems are different 
in nature. The fact that the SG system has a lower value 
of T m i n than the corresponding DFM system is related 
to the fact that local energy barriers against spin flip- 
ping are generally higher in a DFM than in a SG due to 
a nonzero value of the average exchange coupling. The 
phase space structure of the uniform ferromagnet is so 
simple, containing few local energy minima, that the low 
temperature upturn does not develop down to T=0. In 
this case, we shall attribute a zero value to T m i n - The 
similar phenomenon has been observed in the lattice Go 
model with repulsive non-native contacts [ p"5[ for which 
only few local minima are available. The shortest "fold- 
ing" time, t m i n corresponds to tf a id that is determined 
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FIG. 1. The temperature dependence of the characteristic 
"folding" time for the two dimensional FM, DFM', DFM and 
SG Ising systems. Here, L—10 and the number of starting 
configurations is equal to 1000. 
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The temperature dependence of the folding time on N 
is also computed for the Go model of "helices" on the 
two-dimensional square lattice. A "helical" native state 
for iV=16 in shown at the top of Figure 2. The meanders 
shown in the figure become longer and longer when N 
grows. The Hamiltonian for the system is given by 



H 



11 A y 

i<j 



(2) 



where is either 1 or depending on whether the 
monomers i and j are nearest neighbors on the lattice 
but not nearest neighbors along the chain, or not. When 
Aij is non-zero, the two monomers are said to form a con- 
tact. The definition of the Go model is that Bij is 1 for 
the native contacts (such as seen in Figure 2) and oth- 
erwise. Thus the properties of the system are determined 
entirely by the native conformation. The dynamics are 
defined in terms of a Monte Carlo process which satisfies 
the detailed balance conditions as explained in |l^,|l7|,p| . 



H 



n_n_n_n 



12 
11 
10 

9 





T T 

1 f 1 min 
























i i i i 





0.5 1 

T 

FIG. 2. The top of the figure shows an example of a "he- 
lical" conformation on 2D lattice used in the paper. The 
conformation shown is for iV=16. The lower part shows the 
dependence of tf u on T for three indicated lengths of the 
"helix". The values of Tj and T m m are marked by the ar- 
rows. 

The lower part of Figure 2 shows the characteristic U- 
shape dependence of tfoid on T for system H. What is 
different compared to the models of maximally compact 
proteins is that the positions of both T m i n and Tf are 
seen to go down with N - the point to which we shall 
come back in Section 4. 



III. SCALING PROPERTIES OF FOLDING 
TIMES AT Tmin 

In order to study the scaling properties of disordered 
systems, such as the spin systems with random exchange 
couplings, one needs to consider ensembles of samples 
with properties which are similar statistically. Thus for 
each N we have considered up to 50 samples and for each 
we have performed simulations of "folding" in the Monte 
Carlo process. The median folding times as a function of 
T have been calculated for each sample separately and 
we determine their fastest folding condition. Typically it 
is done by considering 1000 folding trajectories at each 
T. But for the FM and DFM' systems with a small size 
up to 40000 trajectories at each T have been used due 
to the broadness of the minimum. The value of t m i n has 
been determined at T=T m i n that corresponded to a given 
sample and only then the average of £ m ,„ over samples 
has been calculated. Figure 3 shows the scaling of the 
average t min for the 2D systems: FM, DFM', DFM, SG 
and H. Figure 4, on the other hand, deals with the 3D 
Ising systems. 




FIG. 3. The scaling of U 
and the "helices" . 



for 2D FM, DFM', DFM, SG 



All of the results are consistent with the power law: 

{t mi n)~N x , (3) 

where the values of A are shown in Table 1. Interestingly, 
A for the spin systems depends much more strongly on 
the type of the spin system than on its dimensionality. 
On the other hand, in the Go models of proteins with the 
maximally compact native state, the dependence on D is 
strong: it is of order 6 and 3 in 2 and 3 D respectively 
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It should also be noted that for the 2D lattice "helices" , 
A w 4.59 is substantially smaller than the exponent found 
for the Go proteins with the maximally compact native 
state which points to the role of the packing effects. 




FIG. 4. Scaling of t min for 3D FM, DFM', DFM and SG. 
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FIG. 5. Scaling of t } for 2D DFM and DFM' (solid lines) 
compared to the scaling of t m in (dotted lines). The effective 
slope for the last three data points corresponding to DFM is 
3.54. 

The strong dependence of A on the choice of the ex- 
change couplings is similar to the lack of universality 
found in model proteins |l| . Also in analogy to the mod- 
els of proteins, the scaling exponent depends on the tem- 



perature. Figure 5 shows that tf u evaluated not at T m i n 
but at Tf grows with an even bigger exponent or possi- 
bly the growth becomes exponential. This emphasizes 
the optimality of the kinetics at T min . In the DFM' case 
tf and t m i n merge together because, as we shall see in 
the next section, the temperatures Tf and T m .;„ merge 
themselves. 



System 



A (L>=2) 



A (L>=3) 



FM 
DFM' 
DFM 

SG 

H 

Go 



0.54 ±0.01 
0.79 ±0.01 
1.85 ±0.05 
3.73 ±0.15 
4.59 ±0.08 
6.3 ±0.2 



0.57 ±0.01 
0.65 ±0.02 
1.25 ±0.05 
3.52 ± 0.25 

3.1 ±0.1 



TABLE I. The exponent A for the 2 and 3 D spin systems 
and for the 2D Go models of helices. The symbol "Go" in the 
table refers to the Go models with the maximally compact 
native states as studied in Ref. [2]. 

The possibility of a power law scaling for the folding 
time has been proposed theoretically by Thirumalai 
(see also Ref. [^(|) based on scaling concepts from poly- 
mer physics combined with some phenomenological as- 
sumptions. In particular, the power law scaling is ar- 
gued to be relevant to proteins which fold through di- 
rect pathways with a nucleation mechanism. For indi- 
rect pathways, the folding time is determined primar- 
ily by activation process with barriers which were ar- 
gued to scale as N 1 / 2 . There has been also a number 
of other studies of how a typical free energy barrier, B, 
in model proteins scales with the number of monomers. 
All of these studies are phenomenological in nature and 
the barrier B is often calculated at the folding transition 
temperature Tf. One assumes that the folding time is 
related to the barrier B through an Arrhenius-like law: 
r ~ exp(B/kBT), as it is typically written for the re- 
laxation time. In the random energy model [TT| , and also 
in another mean field approach for the Go model with a 
nonspecific critical folding nucleus [jl8| the barrier scales 
linearly with N. Recently, Finkelstein and Badredtinov 
pl[ , and also Wolyncs [^2| have proposed a TV 2 / 3 law by 
using a capillarity approximation. Gutin's et al. and our 
power laws for t f id obtained in simulations of the lattice 
proteins would formally correspond to a logarithmic de- 
pendence of the barrier on TV at the temperature of the 
fastest folding. 

It should be noted, however, that the physics of fold- 
ing coincides with that of equilibration only in the limit 
of low temperatures |l6) . At high temperatures, for in- 
stance, the relaxation times are short but the folding 
times are long since the search for the ground state takes 
place primarily in the regions of phase space which are 
energetically remote from the target native state. Thus 
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the behavior of the barriers may have little bearing on the 
folding times at T m in which corresponds to the crossover 
between the physics of folding through equilibration and 
the physics of folding through a search for a state that 
takes place in equilibrium. At low temperatures, the 
roughness of the energy landscape becomes more and 
more significant, and the changed nature of the local bar- 
riers against the reconfiguration is expected to affect the 
scaling laws. Understanding of the scaling behavior of 
the folding time at T m in and at low temperatures still 
needs to be worked out - both in the protein and spin 
systems. The latter systems may prove to be easier con- 
ceptually and computationally. 

IV. SCALING PROPERTIES OF T F AND Tmin 

We now discuss the scaling of characteristic tempera- 
tures. T m i n is determined from the kinetic data. Tf, on 
the other hand, is calculated by starting from the ground 
state and performing a long run that determines the equi- 
librium probability of the system staying in the ground 
state. The probabilities are determined as a function of 
T and Tf is obtained by an interpolation to where the 
value of 1/2 is crossed. For the spin systems, our results 
are based on up to 200 "unfolding" trajectories which 
last for up to 10000 Monte Carlo steps per spin. 
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FIG. 6. Scaling of Tf and T m in for the 2 and 3 D lattice 
Go models of proteins. Data points are taken from Ref. [2]. 

As a point of reference, we first consider the scaling 
properties of Tf and T m i n which were found in the two 



and three dimensional lattice Go models of proteins [g. 
The corresponding data points are now shown, in Figure 
6, as a function of N on the logarithmic scale. Both Tf 
and T m i n grow with N. The data points suggest that 
T m in grows indefinitely - the larger the system size, the 
higher T is needed to secure the optimal folding con- 
ditions. On the other hand, Tf appears to tend to a 
saturation value - there is a limit to the thermodynami- 
cal stability. This finding is consistent with an analytical 
result obtained by Takada and Wolynes Jl8| for Go-like 
proteins studied within a droplet approximation. 

Figure 7 shows the scaling of Tf and T min for the 2D 
lattice "helix" system. At N < 8 the foldability is good 
but on increasing the N, the behavior is entirely differ- 
ent: the glassy effects decrease in importance - T min 
goes down - but also the thermodynamic stability be- 
comes more and more insignificant. The slopes for the 
A-dependence of the two temperatures are somewhat dif- 
ferent and the corresponding plots may cross at some 
large value of A. Thus it is possible that good foldabil- 
ity can reappear at some large values of N - but at a 
very low T. 



2D H 




We now ask what kind of the scaling behavior of Tf and 
T m in characterizes the spin systems? Figures 8-1 1, for 
systems FM, DFM', DFM and SG respectively, demon- 
strate that in no case the scaling is like for the Go lattice 
models with the maximally compact native state but in 
some cases it is akin to the behavior exhibited by the 2D 
"helix". 

Both for the "helix" and for all of the spin systems 
studied here, Tf decreases with A monotonically which 
is not what happens in the Go models of proteins. This 
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difference in behavior can be traced to the following ob- 
servation. Tf is defined through the equation 



l + E'i c M-(Ei-E N )/k B T f ) 2' 

where P/v is a probability of being in the ground state, 
En is the energy of the ground state, Ei is the energy 
of an i'th state, and the sum written in the denomina- 
tor excludes the ground state. At temperatures which 
do not exceed Tf, the sum is dominated by the low en- 
ergy excitations. In the spin systems and in the "helix", 
energies of these excitations do not depend on N. For in- 
stance, in the Ising case they are of order 2z J, where z is 
the coordination number and J denotes a characteristic 
value of the exchange interactions. It is only the num- 
ber of terms in the sum itself that grows with N. This 
leads to Tf decreasing with N. On the other hand, in the 
model proteins, the energies of the excitations typically 
do depend on N which may have a competing effect on 
Tf relative to the impact of the number of states. 

We now turn to discussion of the scaling properties of 
T m in- From Figures 8-11 it is clear that it has opposite 
tendencies for proteins and spin systems. For the 2D 
FM and DFM' systems one observes an increase followed 
by a saturation. In all other spin systems, instead of 
the saturation, one observes a maximum followed by and 
asymptotic decrease. The difference may reflect the pres- 
ence of the kinematic constraints on possible moves in 
proteins due to their polymeric nature. Such constraints 
may cause emergence of barriers which depend on N and 
result in a growing T m i n . In spin systems such kinematic 
constraints do not exist, each spin configuration has N 
possible ways to move out with a cost which does not 
depend on N. Such a high number of degrees of freedom 
gives the spin systems a large flexibility to cross from lo- 
cal minima to local minima. Thus there is no potential 
for an indefinite growth of T m i n . The initial growth, in 
the random systems, reflects on the role of the growing 
number of the local energy minima which may form ki- 
netic traps and make the kinetics glassy. And yet the 
asymptotic decrease of T min suggests that the relevant 
traps do not need a A-dependent energy to overcome or 
points to some entropic effect. 

The case of the "helix" system may appear puzzling 
at a first glance since it possesses polymeric constraints 
and yet they do not lead to a growing T m i n . Note that in 
contrast to the model proteins with maximally compact 
native states [||, the Hamiltonian for the "helix" con- 
tains terms related only to the local contacts. Thus the 
chain is much more flexible it is not tightly packed in its 
native state. The energy barriers against escaping from 
the traps do not depend on the chain length, and there- 
fore the "helix" exhibits the spin-like properties. High 
energetic barriers in proteins are often associated with 
breaking of some tertiary contacts. 
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FIG. 8. The dependence of Tf and T min of 2 and 3 D FM 
on N. 
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FIG. 9. The same as in Figure 8 but for the DFM' systems. 
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V. THE SPECIFIC HEAT AND SUSCEPTIBILITY 
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FIG. 10. The same as in Figure 8 but for the DFM systems. 
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FIG. 11. The same as in Figure 8 but for the SG systems. 



We now compare Tf and T m i n to the usual critical 
temperatures that characterize spin systems. We focus 
on the properties of the specific heat, C, and susceptibil- 
ity, \, defined through 



C = 



(E 2 ) - (Ef 
NT 2 



and 



X = 



(M 2 ) - (Mf 
NT 



(5) 



(6) 



respectively, where M is the magnetization. The tem- 
peratures at which C and \ have a maximum will be 
denoted as Tq and T x , respectively. 

In addition, and in analogy to the proteins |23| ], we 
study the structural fluctuations 



Ax, = (x 2 s ) - (XsY 



(7) 



which are defined in terms of the structural overlap func- 
tion 



1 

Xs - 



N 

E 

i=l 



Si S. 



(N) 



(8) 



where {S'l^} is the spin configuration in the ground 
state. (For the ferromagnets \s is the same as the abso- 
lute value of the magnetization per spin). These fluctu- 
ations also have a maximum at some temperature which 
will be denoted by T s . It has been suggested Q that 
for proteins T s should be about Tf and a small difference 
between T s and Tq is a signature of fast folding. 

All of these thermodynamic quantities are averaged 
over 10 to 20 samples and 100 trajectories for each. In 
each trajectory, the first 5 000 to 10 000 Monte Carlo 
steps per spin are spent for equilibration. The trajecto- 
ries were then further evolved between 20 000 and 50 000 
steps per spin. The lower values above refer to the DFM' 
system and the higher - to the SG system. 

Figure 12 shows the scaling behavior of Tc, T x , and T s 
for the 2D DFM' and SG systems. In the case of DFM', 
the three temperatures converge to one common critical 
temperature. Note that none of these temperatures has 
anything to do with Tf or T m i n . In the SG system, T s and 
T x tend to separate asymptotics than Tq but again none 
of these temperatures coincides with Tf or T TO ,- n . The 
physics of folding is not related to the critical phenomena. 
It should be noted that a phase transition is spin glasses 
shows as a singularity in the nonlinear susceptibility. In 
the 2D SG system, the peak position in the nonlinear 
susceptibility should be at T—0 for any system size [p4[. 
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FIG. 12. The size dependence of T C ,T X ,T S , and T) for the 
2D DFM' and SG systems. 

In summary, we have studied Ising spin systems from 
the perspective of protein folding. We have demonstrated 
that there exist many similarities between the spin and 
polymeric systems. In particular, we have shown that 
both kind of systems have the property of a power law 
scaling of the folding time at T m i n as a function of N. 
We point out that this holds independent of whether the 
system is a good or bad folder and is thus some universal 
feature of folding. 

Among the random spin systems studied here, the 
DFM' systems have the biggest range of the small N 
values at which Tf is larger than T m i n , both in 2 and 3 
D. Thus these small sized systems are the best analogs 
of good folders and can serve as toy models that mimic 
the physics of proteins. Spin glasses of any size, on the 
other hand, do indeed mimic the physics of random het- 
cropolymers. Asymptotically though, each random spin 
system is a bad "folder" . 

This work was supported by KBN (Grant No. 2P03B- 
025-13). M.S.L. thanks H. Rieger for useful discussions. 
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